0 



This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of the 
original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problems Mailbox. 




(12) 



Office europeen des brevets (i 1 ) 

EUROPEAN PATENT APPLICATION 




EP 0(B26 335)A1 



(43) 


Date_of_guWication: 


(51) Int CI. 6 : A61 B 5/103 




04^03. 1938)Bulletn 1998/10 


(21) 


Application number: 971 14468.8 




(22) 


Date of filing: 21.08.1997 




(84) 


Designated Contracting States: 


(72) Inventor: Talmor, Ell T. 




AT BE CH DE DK ES Fl FR GB GR IE IT U LU MC 


Haifa 32984 (IL) 




NL PT SE 








(74) Representative: 


(30) 


Priority: 30.08.1996 US 708080 


AMenburg, Udo, Dipl.-Phys. et al 


< 71 ) 




Patent- und Rechtsanwalte, 


Applicant: 


Bardehle . Pagenberg . Dost . AKenburg . 




ESC Medical Systems Ltd. 


Frortwrtter . Gelssler & Partner, 




Yokneam 20692 (IL) 


Galileiplatz 1 






81679 MQnchen (DE) 



(54) Spectral monitoring apparatus 

(57) A monitoring apparatus for monitoring an 
image of a treatment site (16) and the spectral emis- 
sions from a portion of that region is provided. A CCD 
camera (18) and spectrometer (20) coupled to a hous- 
ing (12) can be directed toward an opening (14) in the 
housing (12). This opening (14) can be placed near a 
treatment site (16) so that an image (44) of the treat- 
ment site and a spectral distribution (42) of the treat- 
ment site can be displayed at the same time. 
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Description 

FIELD OF THE INVENTION 

This invention relates generally to an apparatus for s 
simultaneously viewing and spectrally analyzing a por- 
tion of skin. More particularly, it is directed to a compu- 
ter-aided system for monitoring a spectral output of the 
skin while simultaneously viewing the area of the skin 
that is analyzed. w 

BACKGROUND OF THE INVENTION 

Electromagnetic radiation is used to treat a variety 
of skin disorders, such as vascular and pigmented 75 
lesions, tumors, hair removal, skin rejuvenation, psoria- 
sis, among others. This radiation is typically applied to 
the surface of the skin from a variety of radiation 
sources, such as lasers that emit coherent light, flash 
lamps or arc lamps emitting incoherent light and micro- so 
wave radiation sources, among others. Whatever the 
source of electromagnetic radiation, in order to provide 
treatment without damaging the epidermis and sur- 
rounding tissue, careful consideration must be given to 
the problem of monitoring the course of treatment to zs 
minimize tissue damage, and to optimize treatment 

One method of treatment is called photodynamic 
therapy (POT) and uses a combination of light and 
chemicals to treat a variety of solid tumors, including 
skin cancers, and cancers of the internal organs, such 30 
as colon, vagina, bladder and other cancers. The PDT 
treatment is based on a systemic or topical application 
of a tumor-localizing photosensitizing agent such as 
porphyrin, aminolevulinic acid (ALA), phtalocyanin, 
chlorine, etc., which after illumination and excitation as 
with light in the presence of oxygen, give rise to highly 
reactive and cytotoxic single molecular oxygen which 
causes tumor regression. Typical absorption spectra of 
these chemicals are shown in Figure 1. 

During PDT treatment, light should be applied to «? 
the tumor until the photosensitizer agent is consumed 
by the beneficial chemical reaction. Once this reaction 
is complete and the agent is consumed, any additional 
light applied to the tumor may have little value. Termina- 
tion of the treatment before the agent is consumed is «5 
even worse, since this may leave tumor residuals. To 
prevent this; some PDT operators have used a spec- 
trometer to sense the presence or absence of the pho- 
tosensitizing agent By measuring light emitted by a 
photosensitizing agent in the skin during treatment and 50 
analyzing its spectrum, an operator may easily be able 
to tell whether any photosensitizing agent still exists at 
the treatment site. In the past, measuring the radiation 
emitted from the treatment site has been difficult to 
coordinate with the treatment itself. To measure the 55 
radiation from the photosensitizing agent at the treat- 
ment site, the light source used to stimulate the photo- 
sensitivity agent was removed from the proximity of the 



treatment site and a spectrometer was placed in proxim- 
ity to the treatment site. This process was repeated 
each time the spectral emissions from the treatment site 
was checked until the photosensitizing agent was con- 
sumed. To provide for consistent treatment, the light 
source should have been replaced back at the identical 
spot from which it was removed to apply light to the 
identical area. This often did not happen, however. Each 
time the light source was replaced, it was often replaced 
at a slightly different location. In this manner, the light 
source "migrates" across the treatment site causing 
irregular and nonhomogeneous treatment of the tumor. 

Another problem with current PDT treatment meth- 
ods is the difficulty in accurately orienting the light 
source with respect to the treatment site. Typically, the 
light source obscures treatment site, and prevents the 
light source from being accurately positioned with 
respect to the treatment site. and. in the event that a 
larger area is treated, prevents the light source from 
being relocated to an adjacent area of the treatment site 
without leaving an untreated gap, or without overlapping 
an area that has already been treated, and thus treating 
an area twice, unnecessarily. 

Another application using a combination of light and 
chemicals is called photodynamic diagnostics (PDD). In 
this application, detection of the chemical in the tissue is 
used for tumor diagnosis, since chemical concentra- 
tions in the tumor are much higher than in healthy tis- 
sue. In this application, it is advantageous to view the 
tumor to determine its borders, as well as measure the 
spectrum of fluorescence of the chemicals to provide 
positive identification of the chemical signature. Apply- 
ing light to the treatment she while the chemical fluores- 
cence is monitored enhances the chemical's 
fluorescence and thereby provides a superior spectral 
analysis. As with PDT, this is awkward, since both a light 
source and a spectrometer must be disposed adjacent 
to the treatment area simultaneously. 

The present invention advantageously provides a 
device that can remotely monitor the treatment site with- 
out requiring removal of a treatment or monitoring light 
source. A further advantage of this invention is that it 
allows treatment of the treatment site without requiring 
the light source to be moved while spectral emissions 
from the treatment site are measured. It is yet another 
advantage of this invention that it provides simultaneous 
light stimulation and spectrum monitoring of radiation 
from a treatment site to determine the limits of a tumor. 

SUMMARY OF THE PRESENT INVENTION 

A monitoring apparatus is provided that has a hous- 
ing containing a camera and a spectrometer, both 
directed to an opening in the housing that is disposed 
next to an area to be treated The camera provides an 
image of the treatment site and the spectrometer pro- 
vides a spectrum of the emissions from the same treat- 
ment site. A computer takes the signal from the camera 
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and from the spectrometer and displays the camera 
image of the treatment site on a computer display 
together with the spectral distribution of emissions from 
the treatment site. Thus, both the image (typically 
enlarged) and the spectrum of the treatment site can be 5 
viewed together. The housing may also be coupled to a 
light source for treating that portion of the treatment site 
viewed by the camera. Thus, an operator may simulta- 
neously treat, vi ew. and spectrally monitor the treatment 
site as the treatment proceeds. The image, as well as w 
the spectrum information provided by the computer may 
be saved to make a permanent record of the treatment 

The present invention is directed to a special moni- 
toring apparatus including a housing having an opening 
adapted to be disposed adjacent to a portion of a treat- 75 
merit site, a camera coupled to the housing to view the 
opening, and a spectrometer optically coupled to the 
housing and disposed to sense radiation entering the 
housing at the opening. The spectrometer may include 
an optical bench disposed remotely from the housing 20 
and coupled to a first end of an optical fiber, wherein the 
second end of the optical fiber is coupled to the housing 
and disposed such that it receives radiation entering the 
housing through the opening. At least one lens may be 
provided to focus light entering the housing into the sec- zs 
ond end of the optical fiber. A window may be provided 
that is disposed across the opening in the field of view 
of the camera and between the camera and the open- 
ing. The second end may be coupled to this window 
such that the second end is disposed in a field of view of 30 
the camera. A treatment or monitoring light source may 
be coupled to the housing and disposed so that light 
emitted from the light source is directed toward the 
opening of the housing. The light source may include an 
arc lamp disposed remotely from the housing and a light 35 
guide having a first and second end, wherein the first 
end is coupled to the arc lamp to receive treatment light 
emitted by the arc lamp, and wherein the second end is 
coupled to the housing and adapted to transmit the 
treatment light toward the opening. The apparatus may « 
also include a computer coupled to the camera to 
receive images transmitted from the camera and cou- 
pled to the spectrometer to receive signals indicative of 
the spectrum of radiation entering the housing from the 
opening. The apparatus may also include a computer 45 
display coupled to the computer and adapted to display 
a spectral distribution calculated by the computer from 
the spectral signal and transmitted by the computer to 
the display as well as an image received by the compu- 
ter from the camera. The display may be adapted to die- so 
play both an image and a spectral distribution 
simultaneously. 

Other principal features and advantages of the 
invention will become apparent to those skilled in the art 
upon review of the following drawings, the detailed 55 
description and the appended claims. 



BRIEF DF.y.RIPTinN OF THE DRAWINGS 

Figure 1 is a spectral absorption spectra of photo- 
sensitizing agents for PDT; 
Figure 2 is a partial cross-sectional diagram of a 
monitoring apparatus in accordance with the 
present invention; 

Figure 3 is a partial cross-sectional view of a sec- 
ond monitoring apparatus; 

Figure 4 is a partial cross-sectional view of a third 
monitoring apparatus; and 
Figure 5 is a block diagram of a monitoring appara- 
tus including a computer and display. 

Before explaining at least one embodiment of the 
invention in detail it is to be understood that the inven- 
tion is not limited in its application to the details of con- 
struction and the arrangement of the components set 
forth in the following description or illustrated in the 
drawings. The invention is capable of other embodi- 
ments or being practiced or carried out in various ways. 
Also, it is to be understood that the phraseology and ter- 
minology employed herein is for the purpose of descrip- 
tion and should not be regarded as limiting. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Regarding Figure 2, a monitoring apparatus 10 is 
shown having a housing 12, with an opening 14 dis- 
posed against a treatment site 16 which is typically 
human skin. Housing 12 includes a camera 18 coupled 
to the housing and oriented to receive light entering the 
housing from opening 14. In this case, since the open- 
ing is disposed adjacent to treatment site 16, the cam- 
era receives images of the treatment site that is 
adjacent to opening 1 4. Housing 1 2 preferably provides 
an internal chamber that blocks out external light when 
opening 14 is placed against a treatment site on the 
skin, thus reducing interference from other devices, 
such as fluorescent lights. 

Spectrometer 20 includes optical bench 22 dis- 
posed away from housing 12, and light guide 24 (typi- 
cally an optical f ber or fiber bundle) coupled to housing 
12 and optical bench 22 to direct radiation entering 
housing 12 through opening 14 into optical bench 22. 
Spectrometer 20 is preferably of the type known in the 
art as an optical multichannel analyzer (OMA). The 
advantage to using an OMA is that rapid, nearly real- 
time spectral measurements are possible. OMA spec- 
tral range is generally 400 to 1000 nanometers, 
although a spectrometer 20 providing a narrower spec- 
tral range of 570 to 770 nanometers can be employed 
for fluorescence monitoring. 

A light guide 26 is coupled to the housing to trans- 
mit light from light source 28 into the housing and 
toward the opening 1 4. The light is preferably generated 
either by a laser or a flashlamp, both of which have 
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emissive qualities particularly suited to being coupled to 
housing 12. In this manner light for treatment is sent to 
treatment site 16. 

Light source 28 is preferably a high intensity light 
source such as a xenon or mercury arc lamp. It may s 
have one or more filters, such as a violet filter passing 
wavelengths in the range of 400 to 450 nanometers or a 
green filter passing wavelengths in the range of 505 to 
590 nanometers. These wavelengths are particularly 
useful when using the system in PDT and PDD, since w 
these are the frequencies that cause common photo- 
sensitizing chemicals to fluoresce significantly. 

A window 30 is provided that extends across the 
opening 1 4. Light guide 24 is coupled to the window, 
preferably in the field of view of the camera such that an ts 
image produced by the camera indicates the point at 
which the light guide is coupled to the window. The light 
guide preferably receives light emitted from a spot on 
the treatment site measuring between 1 and 10 mm 2 . 
The window transmits light from the light source out of so 
the housing and onto the treatment sita It also transmits 
light emitted from the treatment site into the housing 
and thence into the camera. The optical fiber preferably 
extends through the window such that it receives light 
emitted directly from the treatment site without having to ss 
pass through the window. The inner and outer surfaces 
of the window preferably have an anti-reflective coating 
to attenuate any reflections internal to the housing from 
entering the camera. Window 30 is preferably recessed 
within opening 14 of housing 12. The depth of this 30 
recess is preferably between 3 and 10 mm. 

The camera is an electronic camera, preferably a 
color or black-and-white CCD camera. The camera is 
disposed to provide an image that includes from 1 to 
100 cm 2 of the treatment site. More preferably, the 35 
image includes from 10 to 40 cm 2 of the treatment she. 
Most preferably, the image includes from 1 5 to 25 cm 2 of 
the treatment site. It may include a filter 32 disposed in 
the camera's optical path to block particular frequencies 
of light, such as the frequencies emitted by the light 40 
source. For typical PDT therapies, the filter should 
transmit light in the range of 570 to 770 mm. This is of 
particular value when the camera is used to sense fre- 
quencies of light emitted by fluorescing photosensitizing 
agents (that typically emit in the 570-770 nm range) in 4S 
response to the light emitted by the light source. When 
the frequencies emitted by the light source are different 
from the frequencies emitted by the photosensitizing 
agents, a filter that eliminates the light source frequen- 
cies can by reducing or eliminating the intense light so 
source frequencies provide enhanced camera percep- 
tion of the fluorescing frequencies. The camera is best 
disposed at an angle of between 10 and 20 degrees of 
a perpendicular which extends from the surface of a 
treatment site (e.g. a plane extending across the open- 55 
ing)- 

In Figure 2. a portion of light guide 24 is disposed in 
the optical path of the camera, and thus tends to par- 



tially obstruct the camera's view. While this obstruction 
cannot be eliminated in the Figure 2 embodiment it may 
be significantly reduced by providing a light guide 24 
having a diameter of between 0.1 and 1 mm A light 
guide of this diameter provides a minimum of interfer- 
ence with the camera's image, while also conducting 
sufficient light from a range of 1 to 10 mm 2 area of the 
treatment site to provide a good spectral analysis of the 
treatment site. 

Opening 14 in this embodiment is substantially cir- 
cular, which allows the light source to illuminate and the 
camera to monitor substantially the same treatment 
area. A second preferred opening is an elliptical open- 
ing where a line drawn through the major axis of the 
ellipse lies substantially in the same plane as a line 
defining the central axis of the camera optics or a line 
defining the central axis of any light emitted by the light 
source, or both. 

In Figure 3, a monitoring apparatus 34 is shown 
similar to that of Figure 2. In this embodiment, however, 
light guide 24 is not coupled to window 30. Lens 36 is 
optically coupled to light guide 24 to focus light received 
into the opening onto light guide 24. Lens 36 is adapted 
to focus light emitted from an area of the treatment site 
measuring preferably between 1 and 10 mm 2 , similar to 
that discussed above. Lens 36 is preferably fixed to the 
housing, adjacent to the camera. 

In Figure 4, a monitoring apparatus 38 is shown 
similar to that of Figure 2. In this embodiment, however, 
optical bench is disposed in the housing itself, eliminat- 
ing the need for optically coupling the optical bench via 
an extended light guide, and thus eliminating the result- 
ant attenuation. As with the embodiment of Figure 3, the 
optical bench in this embodiment includes a lens 36 
adapted to focus light emitted from a treatment site 
measuring preferably between 1 and 10 mm 2 . 

Figure 5 discloses a monitoring apparatus similar to 
any of the above embodiments and further including a 
computer 38 coupled to spectrometer 20, camera 18 
and computer display 40. Computer 38 receives signals 
from spectrometer 20 indicative of the spectrum of light 
received by spectrometer 20. These signals are proc- 
essed by the computer which then transmits an electri- 
cal signal to display 40 causing display 40 to generate a 
representation of the spectrum 42 on the display. In tJie 
preferred embodiment, the spectrum is shown in graph- 
ical form as a function on display 40, in which the hori- 
zontal or X-axis indicates the frequency or wavelength 
of light received by the spectrometer, and the vertical or 
Y-axis indicates a value indicative of the relative inten- 
sity of light received by the spectrometer. 

The computer also transmits signals to display 40 
indicative of the images received by camera 1 8. Display 
40 is preferably adapted to produce these sequential 
images of the treatment site concurrently with the spec- 
trum. One such image (item 44) is shown in Figure 5. 
Thus: an operator of the system can monitor the spec- 
tral emissions of the treatment site simultaneously with 
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an image of the treatment site. Preferably, these images 
and spectrum s are displayed in real time, as the light 
from the treatment site is received by the spectrometer 
and the camera. This mode of operation has a synergis- 
tic effect, allowing the operator of the system to provide 
and monitor treatment by viewing a computer display 
rather than by viewing the treatment site itself. AO the 
information required to determine where and when to 
move housing with respect to the treatment site is pro- 
vided on the screen. 

Image 44 also indicates the point at which the spec- 
trum 42 has been measured. At the point where light 
guide 24 (Figure 2) is coupled to window 30 (Figure 2) 
will appear in each camera image as a small spot or 
shadow. In this manner, the operator will not only be 
able to determine the spectrum of radiation emitted from 
the treatment site, but will be able to identify in the cam- 
era image on display 40 the spot 46 where that meas- 
urement was taken. Alternatively, in an embodiment 
where the light guide is not coupled to the window, such 
as that shown in Figures 3 or 4. a computer generated 
mark may be transmitted to the display to appear in 
each image at the place where the spectrometer meas- 
ured the spectrum. Camera 18 preferably displays a 
larger portion of the treatment site than is sensed by 
spectrometer 20. In this manner, the operator while 
watching the display can view a large portion of treat- 
ment site 16. pan housing 12 about the treatment site, 
and clearly identify various portions of affected region 
48 of treatment site 16 and their corresponding spectral 
behavior. This allows the operator to create in her own 
mind an overall image of the spectral distribution across 
affected region 48. 

Camera 18 is coupled to a frame-grabber circuit 50 
that retrieves successive images of the treatment site 
from camera 1 8 under control of the central processing 
unit 52. The frame-grabber circuit is coupled to central 
processing unit 52, which can be programmed to further 
process the image. By actuating keys, trackball, touch- 
pad, joystick or other user input device (shown here as 
item 56) coupled to central processing unit 52, the oper- 
ator can select particular images, spectra correspond- 
ing to those images, or both, for storage in storage 
device 54, coupled to central processing unit 52. In this 
manner, a treatment can be documented and saved for 
future reference, or for comparison with images of the 
same treatment site to be taken in the future in order to 
determine the effectiveness of treatment 

Spectrometer 20 is here shown with optical bench 
22 disposed within computer 38 and coupled to housing 
12 via light guide 24. Alternatively, the embodiment of 
Figure 4 can be employed, and the optical bench can be 
disposed remotely from the computer or within the 
housing itself. This prevents or reduces light losses that 
may occur due to the attenuation caused by light guide 
24. 

Thus, it should be apparent that there has been 
provided in accordance with the present' invention a 



method and apparatus for simultaneously viewing and 
spectrally analyzing the portion of the skin that fully sat- 
isfies the objectives and advantages set forth above. 
Although the invention has been described in conjunc- 
5 tion with specific embodiments thereof, it is evident that 
many alternatives, modifications and variations will be 
apparent to those skilled in the art Accordingly, it is 
intended to embrace all such alternatives, modifications 
and variations that fall within the spirit and broad scope 
10 of the appended claims. 

Claims 

1. A spectral monitoring apparatus comprising: 

is 

a housing having an opening adapted to be dis- 
posed adjacent to a portion of a treatment site; 
a camera coupled to the housing to view the 
opening; and 

20 a spectrometer optically coupled to the housing 

and disposed to sense radiation entering the 
housing at the opening. 

2. The spectral monitoring apparatus of claim 1 
ss wherein the spectrometer includes an optical bench 

disposed remotely from the housing and coupled to 
a first end of an optical fiber, wherein a second end 
of the optical f toer is coupled to the housing and dis- 
posed such that it receives radiation entering the 
30 housing through the opening. 

3. The spectral monitoring apparatus of claim 1 fur- 
ther comprising a lens coupled to the housing and 
disposed to focus light entering the housing into the 

35 spectrometer. 

4. The spectral monitoring apparatus of claim 2 fur- 
ther comprising a window coupled to the housing 
and disposed across the opening. 

40 

5. The spectral monitoring apparatus of claim 2 
wherein the second end of the optical fiber is cou- 
pled to the window such that the second end is dis- 
posed in a field of view of the camera. 

45 

6. The spectral monitoring apparatus of claim 1 fur- 
ther comprising a treatment and/or diagnostics light 
source optically coupled to the housing and dis- 
posed so that light emitted from the light source is 

so directed toward the opening of the housing. 

7. The spectral monitoring apparatus of claim 6 
wherein the light source comprises an arc lamp dis- 
posed remotely from the housing and a light guide 

ss having a first and a second end wherein the first 
end is coupled to the arc lamp to receive treatment 
light emitted by the arc lamp and wherein the sec- 
ond end is coupled to the housing and adapted to 
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transmit treatment light toward the opening. 

8. The spectral monitoring apparatus of claim 1 fur- 
ther comprising a computer coupled to the camera 

to receive images transmitted from the camera and 5 
coupled to the spectrometer to receive signals 
indicative of the spectrum of radiation entering the 
housing from the opening. 

9. The spectral monitoring apparatus of claim 8 fur- to 
ther comprising a computer display coupled to the 
computer and adapted to display a spectral distri- 
bution calculated by the computer from the spectral 
signals and transmitted by the computer to the dis- 
play as well as an image received by the computer is 
from the camera. 

10. The spectral monitoring apparatus of claim 9 
wherein the display is adapted to display both an 
image and a spectral distribution simultaneously. so 
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